Biological Imaging
◐ Cambridge University Press (CUP)
Preprints posted in the last 30 days, ranked by how well they match Biological Imaging's content profile, based on 15 papers previously published here. The average preprint has a 0.01% match score for this journal, so anything above that is already an above-average fit.
Rapilly, Q.; Badoual, A.; LIU, Y.-H.; Kervrann, C.
Show abstract
In this paper, we introduce Nagini3D, a 3D biological image segmentation method that hybridizes two high-performing yet highly complementary segmentation paradigms: deep learning-based approaches and snake-based methods. Our approach leverages both the high efficiency of data-driven techniques and the convenient shape representation provided by active surfaces, which proves highly practical for incorporating a priori knowledge as well as for the post-analysis of segmented objects. By considering a complete 3D volume, our method ensures segmentation consistency across all three dimensions, unlike many approaches that handle volumes in a slice-by-slice manner. Additionally, it theoretically enables the representation of any object with spherical topology, overcoming the limitations of common 3D methods that rely on object convexity assumptions. Furthermore, the continuous representation of objects allows for a resolution-independent description, facilitating the extraction of various geometric features of interest (e.g., local curvature, principal deformations). We demonstrate both the quality of the segmentation produced by our method and the richness of the accessible geometric features through an extensive set of experiments conducted on multiple real and simulated datasets, including objects with challenging geometries.
van Dijk, S. G.; Ledesma-Terron, M.; Kraus, S. J.; van Brussel, R.; Marquez Legorreta, E.; Kemp, L. J. S.; Suijkerbuijk, S. J.
Show abstract
Nuclear segmentation in 3D microscopy remains challenging, particularly for low signal-to-noise ratio (SNR) data from timelapse imaging, in vivo experiments, or dense tissue samples. Yet accurate 3D nuclear segmentation is a prerequisite for quantitative single-cell analysis, making this a key bottleneck for high-throughput study of challenging datasets. We present NucLogic, a fast and robust 3D nuclear segmentation algorithm that combines the maturity of 2D segmentation with geometric stitching rules based on nuclear shape, orientation, and intensity, to reconstruct accurate 3D volumes. NucLogic reliably segments challenging datasets including long-term timelapse imaging of organoids, and large dense structures such as the zebrafish brain. Benchmarked against other state-of-the-art segmentation tools, NucLogic matches F1 scores at high SNR, with increasing outperformance as SNR decreases. Importantly, segmentation completes at 20-50% of the computation time, with greater speed gains on larger images. Beyond segmentation, NucLogic includes an intuitive graphical user interface allowing non-experts to segment, quantify, and visualize 3D and 4D data. This enables easy quantification of cell numbers and integration of a variety of both cell-intrinsic properties, such as phenotype, morphology, and local environment metrics, including density and spatial interactions. Together, NucLogic makes quantitative 3D nuclear analysis of previously unmanageable datasets accessible to a broad research community.
Du, Y.; Li, S.; Yang, X.; Shu, H.; Wang, Z.; Zhang, D.; Zou, Q.; Yuan, Z.
Show abstract
Preprocessing of spatial transcriptomics (ST) count matrices is critical for removing technical variation while preserving biological signals, but optimal strategies remain unclear across diverse platforms. We systematically benchmarked 371 preprocessing workflows across 45 data spanning 11 mainstream ST platforms, evaluating their performance using specifically designed complementary metrics. To further assess preprocessing factors upstream of count-matrix generation, we additionally evaluated image preprocessing, including cell segmentation and post-segmentation transcript processing, across representative imaging-based ST platforms. We found that no universal count-matrix preprocessing workflow performed optimally across all platforms, while data from the same platforms exhibited striking consistency in optimal count-matrix preprocessing workflows. We identified the key data structure characteristics and count-matrix preprocessing steps that critically influence preprocessing performance. We developed platform-specific and data structure-guided recommendations to assist users in selecting the optimal count-matrix preprocessing workflow, validated across a broader range of downstream tasks. We demonstrated that our data-driven recommendations uncover subtle biologically meaningful spatial patterns in new data that were obscured by suboptimal count-matrix preprocessing. Our findings suggest best practices for ST data count-matrix preprocessing.
Herreros, D.; Sorzano, C. O. S.; Carazo, J. M.
Show abstract
Cryo-Electron Microscopy (CryoEM) Single Particle Analysis (SPA) is pivotal for elucidating protein structures and their conformational dynamics. Several critical steps are required to obtain accurate maps. First, the \textit{ab initio} relative orientations and shifts between images must be determined. Second, the common issue of specimens presenting a preferred orientation should be adequately addressed. Third, all of the above must account for particle flexibility and sample heterogeneity. Additionally, these steps are interrelated, making the search for all these parameters a real challenge when considering convergence robustness. In this context, we present ReconSIREN, a novel deep learning framework that addresses the key steps outlined before in an \textit{ab initio} manner while greatly minimizing one of the most important practical burdens in SPA, namely the errors introduced in the CryoEM maps by the existence of preferred orientations; the latter is achieved by a change of the optimization approach that avoids the so-called ``attraction problem'', and by the introduction of a new type of geometrical priors. It does so fully \textit{ab initio}, using deep learning training/inference steps without resorting to more traditional optimization approaches, and generating highly accurate initial reconstructions. We present maps as both homogeneous (consensus) maps and a full conformational landscape for analyzing flexibility and heterogeneity. Thanks to its Mixture-of-Experts (MoE) architecture, ReconSIREN distributes the estimation workload across independent experts, improving optimization efficiency and simplifying the process.
Bobotis, B. C.; Landwehr, A.; Hadera, V.; Trudel, A.; Gomes, F.; Tremblay, M.-E.
Show abstract
The field of microglial research has evolved throughout the years. Microglia, the immune cells of the central nervous system, are recognized as highly heterogeneous and dynamic cells, known for modifying their structure and function based on the local context. Investigating microglial density, spatial distribution, and morphological states is important for uncovering their distinct functional states in health and pathology. However, quantifying these features accurately is often a methodological challenge. Fully automated computational approaches often fail to capture subtle biological nuances and complex structural variations. Also, the high diversity of image sets makes it difficult to maintain consistent reliability. In contrast, entirely manual quantification is labor-intensive and prone to observer bias. To bridge this gap, we propose a semi-automated framework using the open-source software CellProfiler. Our workflow is divided into two distinct pipelines designed to combine automation of batch analysis with targeted user oversight, allowing for manual intervention when necessary to ensure maximum accuracy. Both pipelines are capable of recognizing microglial soma and tracing their processes. In the density workflow, it automatically calculates cell density and provides spatial distribution measurements, such as closest-neighbor distance and spacing index. For morphological profiling, it yields extensive structural data, including area, perimeter, convex area, form factor, and various shape descriptors. Furthermore, we demonstrate how researchers can optimize the pipeline settings to accommodate varied image datasets and experimental conditions. We hope this open-source framework can standardize microglial density, distribution, and morphological analysis and reduce systematic bias, providing researchers with a robust tool to better characterize their heterogeneity.
Royer, L. A.
Show abstract
Volumetric microscopy produces datasets too large to share as files and too rich to convey as still images, yet exploring them interactively means installing desktop software or building web infrastructure. Here we present Luxar, an open-source Python framework that compiles multidimensional data into compact archives that any modern browser renders from static file hosting. Fluorescence volumes are represented as mixtures of anisotropic Gaussians (Gaussian splats): the image becomes geometry that the GPU draws directly, with no voxel grid to rebuild. Splats share one scene with points, trajectories and surfaces. Blind-spot cross-validation sets the number of Gaussians without noise-free references. Across 17 volumes from 12 datasets and four modalities, this yields a median 99-fold (6- to 340-fold) size reduction at 26 to 67 dB peak signal-to-noise ratio (PSNR), in minutes per volume on one GPU. We demonstrate Luxar on a 500-timepoint embryogenesis recording, super-resolution localisations, single-cell atlases and lineage tracking, each explorable through a shareable link.
Giustolisi, A.; Avenel, C.; Wählby, C.
Show abstract
In situ sequencing methods provide subcellular-resolution gene expression data while preserving spatial context, enabling the integrated analysis of genomics and tissue morphology. However, many clustering workflows represent spatial transcriptomic structure through hard labels, imposing sharp boundaries between transcriptional domains and limiting the visualisation of gradual transitions, mixed signals, and uncertainty in cluster assignment, resulting in potentially misleading interpretations of tissue organisation. Here we present SFUMATO (Segmentation-Free Uncertainty Mapping and Analysis of Transcriptomic Organisation), a GPU-accelerated Bayesian probabilistic clustering and visualisation framework for spatial transcriptomics. SFUMATO builds on segmentation-free, multi-scale transcript binning and applies a Bayesian Gaussian mixture model to infer posterior probabilities over transcriptional components at each spatial location. These posterior probabilities provide a unified representation for hierarchical clustering, uncertainty-aware visualisation, and quantitative estimation of transcript-defined area fractions. SFUMATO assigns related colours to transcriptionally related components and blends colours according to posterior probabilities, producing maps in which sharp boundaries, gradual transitions, and ambiguous regions are represented directly in the visualisation. Classical hard labels remain recoverable from the same posterior distributions, preserving compatibility with downstream analyses that require discrete clusters. We evaluate SFUMATO on public 10x Genomics Xenium mouse brain and human breast cancer datasets. In mouse brain, SFUMATO preserves local transcriptional similarity in its colour encoding, maintains hierarchically consistent visualisations across different numbers of clusters, and recovers cell-associated spatial organisation without requiring prior cell segmentation. In breast cancer, SFUMATO-derived posterior maps can be converted into semantic masks concordant with pathology-associated regions, particularly invasive carcinoma, while highlighting the greater heterogeneity of DCIS-associated tissue. Together, these results show that SFUMATO provides an interpretable probabilistic representation of spatial transcriptomics that connects clustering, visualisation, and semantic segmentation across cell-associated and niche-level scales. More broadly, SFUMATO also provides a compact and continuous representation of highly multiplexed spatial transcriptomic information, offering a flexible input for future downstream analyses and multimodal integration.
Mihaylova, M.; Ankan, A.; Sultan, S.; Wortel, I. M.; Postat, J.; Harris, M.; Merino, M.; Mandl, J. N.; Textor, J.
Show abstract
Traditional cell tracking methods focus on fully automated tracking. The quality of the generated tracks, however, is heavily influenced by factors such as cell speed and density. In complex scenarios where track correctness is essential, an efficient and reliable tool for manual track correction remains a key component of the cell tracking process. Most tracking tools that allow for such manual correction do so only as a post-processing step, using human feedback to correct one track error at a time -- without improving the quality of other tracks in the dataset. This highlights the need for a more efficient track correction method that iteratively integrates human feedback into the automated tracking process. In this paper we propose a human-in-the-loop approach to cell tracking and investigate the extent to which a tracking algorithm can learn from human input during the tracking process. We combine a graph representation of cell detections, Dijkstra's shortest path algorithm, and a neural network that predicts cell displacement to generate initial track suggestions. We introduce a tool that enables human feedback on individual tracks suggested by the algorithm; this feedback is then propagated to improve subsequent track generation. Compared to the traditional approach of fully automated tracking with correction as a post-processing step, our human-in-the-loop tracking framework reduces the number of corrections required. Finally, we show how this approach can be integrated with existing state-of-the-art tracking algorithms by using pre-generated tracks as a prior, improving the quality of tracks suggested to the human annotator.
Vasinkova, M.; Jochymek, L.; Gajdos, P.
Show abstract
Machine learning benchmarks often treat image files as independent observations, although multiple files may represent repeated views or other related samples. Prior work has shown that non-independent partitioning can inflate model performance, but the sensitivity of a biomedical benchmark to progressively increasing train-test relatedness is less often quantified. Here, we quantified how apparent classification performance changes when recoverable sample groups are progressively allowed to cross training, validation, and test partitions. Using source structure and filenames, we reconstructed analysis groups in a microscopy corpus compiled from multiple sources and generated five class stratified partitioning conditions, ranging from an intact group reference to random assignment of individual files. We applied the same training recipe within each model family to 129,173 images spanning 14 classes of blood cells and hematopoietic cell states. For a pretrained Vision Transformer, random assignment of individual files increased the mean test macro F1 from 0.853 to 0.977 and accuracy from 0.851 to 0.990 relative to the intact group reference. Apparent performance increased progressively across the intermediate conditions. The endpoint pattern also appeared with a ResNet-50 backbone, and the largest apparent gains occurred in immature granulocytic and blast classes. A descriptive analysis within the random assignment condition further showed higher scores among test images that had another member of the same group in the training set, although the exposed and unexposed subsets were not exchangeable. The grouping workflow, exact split definitions, code, and compact result files are released as HSD-Bench to support reproducible evaluation of hidden sample dependence.
Niwase, S.; Fujiyama, A.
Show abstract
Defining tumour regions on haematoxylin and eosin (H&E) sections is a routine first step in spatial-omics studies, yet it is usually done by hand and is difficult to reproduce. We present OmiCoreTumorDetector, an openly licensed model that maps tumour-enriched regions in colorectal cancer (CRC) H&E sections and exports them as QuPath-compatible annotations. The released model (omicore-tumordetector-crc-he-v0.1) is an ensemble of three convolutional classifiers trained on 100,000 public tissue tiles, combined with Macenko stain normalisation at inference. During development we found that the main obstacle to reuse was calibration under stain-domain shift rather than discrimination: a single model kept an area under the ROC curve (AUROC) of 0.955 on unseen slides while its sensitivity at the conventional 0.5 threshold fell to 0.48. Training on non-normalised tiles raised tumour AUROC on an independently collected tile set from 0.836 to 0.992, and normalising at inference reduced false-positive tumour area in normal-adjacent tissue by 16- to 26-fold. On five 10x Visium HD CRC sections that share no material with the training data, the released model called 27.7-48.5% of tissue as tumour in three carcinoma sections and 0.08% and 1.82% in two normal-adjacent sections, exporting no tumour region from either normal section. On the carcinoma section with matched single-cell-resolution transcriptomics, agreement with transcriptome-derived tumour-cell identities reached an AUROC of 0.985 (95% spatial-block bootstrap CI 0.975-0.993). The image model never observes gene expression, so this is orthogonal evidence. The model localises tumour-enriched regions at 112 um resolution; it does not identify individual malignant cells and has not yet been validated across scanners, institutions or histological variants. Code, weights and evaluation are released under Apache-2.0 and installable with pip install omicoretumordetector.
Baruchin, L. J.; Cozan, M.; Mikhniak, A.; Stringer, C.; Schröder, S.
Show abstract
Two-photon calcium imaging enables measurements of neural activity from individual neurons and their subcellular processes in awake animals. Axial brain motion can change measured fluorescence independently of neural activity and move small structures out of the imaging plane, confounding two-photon calcium measurements in behaving animals. We developed two complementary post-acquisition methods, selected according to whether the imaged structure remains detectable across the encountered depth range. When it does, z-stack correction estimates imaging depth from a separately acquired reference z-stack and uses an axial fluorescence profile specific to each neural structure to rescale fluorescence to a common reference depth. When a structure can leave a single imaging plane, volume-based z-registration reconstructs a common-depth movie from repeated acquisitions of closely spaced planes. In awake mice, both methods tracked experimentally imposed axial displacements within the sampled range, with depth-estimation root mean squared errors (RMSEs) below 1 m for z-stack correction and 0.69-1.03 m for volume-based z-registration. Correction changed fluorescence substantially for a subset of somata, with larger effects in axonal boutons. Both methods are implemented in suite2p-in-depth, a Python package that integrates with Suite2p and provides diagnostics for depth estimation, correction quality and data reliability. Together, these methods enable axial-motion artifacts to be assessed and corrected within established Suite2p workflows.
Szabo, K.; Kerbl, A.; Mocaer, K.; Svetlove, A.; Pacureanu, A.; Jekely, G.
Show abstract
Serial-sectioning electron microscopy allows the exploration of the 3D ultrastructure of cells, tissues or whole organisms. Sample preparation is a critical step for this technique, which determines the quality of downstream imaging and analysis. Here we optimize a high-pressure freezing sample-preparation workflow for larvae of the marine annelid Platynereis dumerilii. We tested several fixation and staining methods and screened a large number of specimens by synchrotron X-ray imaging to evaluate specimen integrity and contrast. We further evaluated selected blocks by array tomography SEM to select the best performing protocols. Our protocols and robust workflow could be adapted to similar marine planktonic organisms including ciliated invertebrate larvae.
Bielow, C.; Walzer, M.; Hoffmann, N.; Uszkoreit, J.; Mirzadeh Sarcheshmeh, F.; Nicolaus, F.; Andernach, L.; Boschmann, P.; Burla, B.; Dogu, E.; Eisenacher, M.; El Abiead, Y.; Jimenez-Morales, D.; Neumann, S.; Perez-Riverol, Y.; Sachsenberg, T.; M Salek, R.; Strobel, M.; Tenzer, S.; Van Den Bossche, T.; Vitek, O.; Wang, M.; Tabb, D. L.; Bittremieux, W.
Show abstract
Reliable quality control (QC) is essential for reproducible biological mass spectrometry, yet QC information is still typically stored in tool-specific, poorly interoperable formats that hinder comparison, reuse, and transparent reporting. We present mzQC, a community-developed standard from the HUPO Proteomics Standards Initiative for the compact, machine-readable representation of QC metrics and their associated metadata across mass spectrometry workflows. mzQC is implemented in JSON, organized to support both individual mass spectrometry acquisitions and collections thereof, with formal QC metrics definitions supported by controlled vocabularies to ensure unambiguous metric interpretation and semantic consistency. The format is supported by validation tools and reference libraries in Python, R, and Java, facilitating integration into existing software ecosystems. We demonstrate the utility of mzQC across diverse analytical modalities and QC settings, spanning longitudinal instrument monitoring, acquisition-method evaluation, study-level quality assessment, repository-scale data characterization, and spatially resolved mass spectrometry imaging. Together, these use cases show that mzQC provides not merely a file format, but a shared foundation for interoperable QC reporting, large-scale data assessment, and more rigorous, reproducible, and reusable mass spectrometry-based research.
Rey-Paniagua, G.; Garcia-Lopez-de-Haro, C.; Hernandez-Martinez, M.; Lachowski, D.; Munoz-Barrutia, A.
Show abstract
Focal adhesions (FAs) and actin stress fibers (SFs) are mechanically coupled but often analyzed separately. We present FilAdh, a unified framework for FA instance segmentation, SF instance reconstruction, morphometry, and FA-anchorage-based SF classification. Across 57 held-out HeLa, SUIT-2, and MRC-5 cell line images, FilAdh achieved the highest FA Dice, intersection over union (IoU), and recall and the highest SF clDice and skeleton precision among benchmarked methods; paired t tests with Holm correction indicated significant gains over all compared methods for FA Dice, IoU, and recall, and over classical methods for SF centerline metrics, with no significant differences detected relative to the deep-learning comparators. Conditional on expert-curated FA and SF masks, SFs were assigned to dorsal, ventral, and peripheral classes with 81.5%-87.3% accuracy. Controlled Poisson-Gaussian noise, Gaussian defocus, and point-spread-function blur revealed distinct, structure-specific errors in overlap and object-level measurements. By linking segmentation and reconstruction to count, area, length, apparent width, and structural class, FilAdh offers an interpretable view of the FA-actin structural system and makes degradation-dependent measurement biases explicit. BIGGER PICTURECells sense and respond to their physical environment through focal adhesions and actin stress fibers. The two form a mechanically coupled system, yet they are usually analyzed separately, with workflows re-tuned for each new set of images. FilAdh analyzes both within a single framework, tailoring segmentation, reconstruction, and classification to each structures geometry: compact adhesion patches versus thin, extended fiber networks. Testing on expert-annotated references and under controlled degradations that mimic low signal, focus errors, and optical blur shows that these common imaging imperfections distort adhesion and fiber measurements in different ways. The same design principle--matching the analysis to each structures shape and judging methods by how errors propagate into the final biological measurements--may benefit other bioimage-analysis problems. Released code, trained weights, and fixed data splits make all comparisons reproducible and extensible. HIGHLIGHTSO_LIFilAdh jointly quantifies focal adhesions and actin stress fibers C_LIO_LIFilAdh achieves the highest benchmarked FA overlap and comparable SF topology C_LIO_LIMatched synthetic degradations reveal geometry-specific measurement errors C_LIO_LIFA-SF spatial context enables dorsal, ventral, and peripheral SF classification C_LI
Jenie, I.; Mishkin, E.; Smith, E.; Kenney, M.; Cao-Berg, I.; Maimon, R.; Ropelewski, A. J.; Cleveland, D. W.; Bintu, B.
Show abstract
Interactive exploration and sharing of hybridization-based spatial transcriptomics datasets remain limited by large file sizes, specialized software, and computationally intensive preprocessing, restricting rapid access to publicly available resources such as the Brain Image Library. Here we present MERFISHEYES (https://merfisheyes.com), a browser-based platform for interactive visualization of single-cell and single-molecule spatial transcriptomics data across commercial and emerging high-throughput platforms. MERFISHEYES enables marker gene exploration, cross-dataset and cross-species comparison, visualization of subcellular RNA localization, and collaborative sharing through browser-accessible links generated directly from drag-and-drop datasets. We use MERFISHEYES to enable browser-based visualization of all 158 spatial transcriptomics datasets in the Brain Image Library and demonstrate its capabilities in handling high-throughput 3D data with genome-scale imputation of gene expression and DNA accessibility. MERFISHEYES provides a scalable framework for rapid exploration, sharing, and collaborative analysis of spatial transcriptomics data.
Krall, S.; Blum, B.; Smialkovska, V.; Oezcan, E.; Dachtler, S.-V.; Oldfield, G.; Feldmann, A.
Show abstract
Functionally linking enhancers to gene promoters at high resolution often entails analysis of 3C datasets, including viewpoint-based methods such as Capture-(Hi)C. Quantitative comparison across samples and experiments, together with visualization and integration of promoter interactions with other datasets are of critical importance. While existing statistical tools identify significant interactions and quantify underlying signal, systematically comparing the shape and extent of this signal across large sets of intervals remains challenging. Moreover, experimental artefacts, such as inefficient crosslinking, can affect downstream interpretation, but are difficult to detect systematically. Here we introduce PostChicago, an R/Bioconductor package that fills this gap. Building upon the widely used interaction-calling package Chicago, PostChicago provides a complete workflow for quality control, visualization, integration and quantitative analysis of promoter interactions between multiple samples, including annotation and quantification of genomic regions based on external datasets. PostChicago extends visual quantitative comparisons beyond individual viewpoints by computing normalized metaprofiles around large sets of intervals that visualize the distribution of interaction signal, enabling comparison between narrow and broad interaction patterns. We further demonstrate how PostChicago can identify experimental crosslinking artefacts. Together, PostChicago enables integrative, shape-sensitive analysis and quality control of promoter Capture-(Hi)C datasets at a scale that would otherwise require extensive custom scripting.
Zhang, X.; Fang, M.; Geng, B.; Che, P.
Show abstract
Inflammatory activation remodels the Golgi apparatus to meet increased secretory demand, yet whether these structural changes carry computationally accessible information about immune cell state has not been explored. Here we show that machine learning applied to imaging flow cytometry images of the Golgi can distinguish lipopolysaccharide (LPS) treated from control cells. We trained models on Golgi images from human THP-1 monocytes before and 16 h after LPS stimulation in vitro, and from circulating myeloid cells of mice 24 h after intratracheal LPS or saline in vivo. In each dataset, the best-performing model was a deep learning model trained directly on images rather than a classifier using predefined morphometric features. Cross-domain performance varied with the model, transfer direction and use of labelled target data: several deep learning models trained on mouse images classified THP-1 cells above chance without changing model parameters. Grad-CAM highlighted regions within or adjacent to the GM130 fluorescence pattern. These findings indicate that GM130 images carry information associated with LPS treatment that supports classification within and across the two datasets. To our knowledge, this is the first application of supervised deep learning to imaging flow cytometry images of a subcellular organelle for inflammatory phenotyping, establishing organelle level image analysis as a potential complement to molecular assays for immune cell classification.
Brown, H. G.; Valimehr, S.; Styczynski, D.; Mudaliyar, M.; Kundapura, S. S.; Johnson, M. D.; Ghosal, D.; Hanssen, E.
Show abstract
The visualisation of large biological samples in cryo-electron tomography requires both few-nanometre resolution and a wide, ideally >10 micrometrre, field of view. For a single image, increasing magnification trades increased resolution for a smaller field of view. Montaging, where high-magnification images are stitched together to increase field of view, addresses the trade-off but is dose-inefficient with round beams that are standard in transmission electron microscopy (TEM), since this illumination shape does not tessellate. Our workflow greatly simplifies montaging schemes for dose-sensitive specimens, allowing large montages of any shape - from individual cells or other features of interest up to whole lamellae - to be collected at high resolution without compromising electron dose efficiency. We demonstrate the workflow by acquiring montage tomograms of whole yeast (Saccharomyces cerevisiae) cells in cryo-FIB lamellae and of human neurons.
Vizcarra, J. C.; Kataria, B. C.; Chuah, C.-N.; Pearce, T. M.; Dugger, B. N.; Candano, C. A.; Rosado, A. M.; Cooper, L. A.; Gutman, D. A.
Show abstract
Foundation models (FMs) have rapidly become dominant in artificial intelligence and are increasingly being adopted in computational pathology. Numerous pathology-specific FMs have been developed and evaluated for a variety of downstream tasks, most commonly using frozen image embeddings with linear probes. While a pathology FM, at least implicitly suggests broad reusability across tasks, the transferability of these models to neurodegenerative disease-related tasks remains largely unexplored. In this study, we evaluated fourteen frozen feature extractors, including general-vision and pathology FMs, across four pathology image classification datasets spanning two specialized neurodegenerative disease immuno-histochemistry (IHC) tasks (Tau neurofibrillary tangle (NFT) and amyloid-{beta} plaque classification) and two cancer-related hematoxylin and eosin (H&E) tasks (the breast tissue BACH dataset and the multi-tissue TIL dataset). The cancer-related H&E datasets represent tasks more closely aligned with the predominant pretraining domain of many current pathology FMs, whereas the neurodegenerative IHC datasets represent a more specialized domain with limited representation in existing FM pretraining cohorts. Frozen embedding linear probes were compared against a conventional supervised ResNet-50 convolutional neural network (CNN) trained directly on image tiles using identical train, validation, and test splits. Across both neurodegenerative IHC datasets, the supervised CNN substantially outperformed all frozen FM linear probes. In contrast, pathology FMs achieved performance comparable to, and in some cases exceeding, the supervised CNN across the two cancer-related H&E datasets, with UNI2-h achieving the highest performance on BACH and several pathology FMs performing on par with the CNN on the larger TIL dataset. Furthermore, a supervised CNN trained using only 1% of the Tau NFT training data (1,938 tiles) still exceeded the performance of the best frozen FM linear probe trained on the complete dataset. Together, these results suggest the transferability of frozen pathology FMs may depend strongly on how well the downstream task is represented by their pretraining domain. These findings demonstrate frozen pathology FMs transfer effectively to the cancer-related H&E tasks evaluated here but may be less effective for specialized neurodegenerative IHC tasks less well represented in current FM pretraining cohorts. Expanding pathology FM pretraining datasets to include a broader range of disease domains and staining modalities may therefore improve transferability to specialized pathology applications. Our findings also highlight the continued importance of conventional supervised learning and motivate future work investigating nonlinear probes and end-to-end FM fine-tuning.
Li, C.; Wang, J.; He, C.; Wang, H.; Geng, S.; Lao, Y.; Zhang, Y.; Zhu, Y.; Wu, S.
Show abstract
Deciphering the functions of post-translational modifications (PTMs) is a critical bridge connecting large-scale modification proteomics data to mechanistic studies. However, most existing tools for visualizing PTM omics data are limited to site catalogs or single-dimensional feature displays. They lack the capability to simultaneously map user-derived differential modification sites onto multi-dimensional contexts, including protein three-dimensional (3D) structure, evolutionary conservation, functional sites, and disease associations. This limitation makes it difficult for researchers to rapidly assess the biological importance of candidate sites from among a vast number of differentially modified sites. Here, we present PTMExplorer, an interactive platform for the multi-dimensional visualization of protein PTMs. PTMExplorer comprises three core modules: PTM Inspector, built upon ProtVista, provides a multi-track, sequence-feature integrated view incorporating intrinsically disordered region (IDR) prediction (via flDPnn), surface accessibility calculation (via FreeSASA), and UniProt functional annotations; PTM 3D Locator, leveraging the Nightingale/Mol* engine, anchors modification sites onto AlphaFold/Protein Data Bank (PDB) 3D structures through residue mapping via PDBe-SIFTS; and PTM Overview, utilizing the R circlize package, presents a panoramic polar circos plot illustrating modification distribution and inter-group differential regulation. Additionally, three major disease-associated modification databases (PTMD, qPTM, and PhosCancer) are integrated as PTM-Disease Nexus, enabling co-localization comparison between user-defined differential sites and reported disease-related sites. PTMExplorer currently supports eight model organisms, accepts user-uploaded differential analysis results, and provides multi-dimensional annotations and various visualization options (https://www.bioladder.cn/PTMExplorer/). Using a multi-omics dataset from hepatocellular carcinoma (18 patients, 9 modification types) as a case study, we demonstrate the practical utility of PTMExplorer in screening potential biomarkers, revealing multi-modification coordination mechanisms, and distinguishing between absolute and relative quantification patterns.